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SYSTEM AND METHOD FOR MANAGING FLOW BANDWIDTH 
UTILIZATION IN A PACKET COMMUNICATION 
ENVIRONMENT 

FIELD OF INVENTION 

5 The present invention relates to digital packet telecommunications 

and, in particular, to a system and method for managing utilization of the 
flow bandwidth in a packet communication environment. 

BACKGROUND OF INVENTION 

In a network environment, the bandwidth management of the 

O 10 network is a key issue as the data streams flowing over the network 
increase. In the art of the network bandwidth management, persons skilled 

f;\ in the art usually control the bandwidth of each traffic stream by following 

the policy-based QoS Rules that users predefined. Actually, the bandwidth 

ry management of the network has several advantages, such as the protection 

1 5 of maximum allowable traffic streams and the decreased occurrence of end- 

O to-end traffic congestion. In order to achieve the bandwidth management, 

several traditional techniques are proposed to approximate the properties of 
GPS (Generalized Processor Sharing) (see references 2, 6, and 13 in the 
Appendix for details). These techniques are WFQ (Weight Fair Queuing), 
20 WF 2 Q (Worst-case-Fair Weighted Fair Queuing), etc. (see references 1,3,4, 
and 12 in the Appendix for details). In fact, these traditional mechanisms 
are all directed to weighted-based bandwidth management algorithms, and 
the research community has paid a lot of attention to such algorithms. 
Furthermore, the WFQ has been proposed to be a basic building block for 
25 future integrated services networks by Internet Engineering Task Force 
(IETF). However, these techniques are so complicated that they cannot be 
cost-effectively implemented in high-speed network devices (see references 
3 and 5 in the Appendix for details). Besides, they also cannot achieve 
user- friendly control manner, rate- limiting control. 
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To resolve the problems mentioned above, in some existing network 
equipments an active rate control scheme is employed (see references 7, 8, 
9, 10 in the Appendix for details) in a bandwidth management device. In 
such an active rate control scheme, control messages are actively sent to 
each of end-points of the network according to the latest rate control status 
of each traffic stream, such that the transmission rates of all end-points can 
be actively slowed down or speeded up based on the sent control messages. 
However, the active rate control scheme inevitably generates a lot of 
control messages, and from the viewpoint of network utilization, these 
control messages are substantially all kinds of dummy packets. Therefore, 
the active rate control scheme still wastes a lot of bandwidth available for 
the network, even though this scheme can control the rate of each traffic 
stream very well. 

SUMMARY OF INVENTION 

To resolve the above-mentioned flow control of the network, the 
present invention provides a novel rate control scheme, Time-Division- 
Queue Rate Control Scheme (TDQ-RCS). The TDQ-RCS according to the 
present invention can rapidly determine the departure time of the arrival 
packet, add this arrival packet into the time division queue to which it 
belongs according to its departure time, and then output the packet on 
schedule. Moreover, all algorithms employed by this TDQ-RCS can be 
completed in a constant time since these algorithms are simple for the 
arrival packets of different sizes. Especially, the TDQ-RCS neither 
generates any dummy packet nor wastes any bandwidth but still can 
accomplish the bandwidth management. Therefore, by using the inventive 
TDQ-RCS, the present invention can obtain the following benefits easily: 

( 1 ) Management of network resources ; 

(2) Management of bi-directional bandwidth; 

(3) Guarantee of bandwidth for applications/services/customers/ 
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stations; 

(4) Control of traffic stream without generating any dummy 
packet; and 

(5) Friendly rate limitation of QoS control manner. 

Therefore, one advantage of the present invention is to provide a 
method and device for significantly managing the bandwidth of a data 
communication network without generating any dummy packet and wasting 
the bandwidth based on the TDQ-RCS according to the present invention. 

Another advantage of the present invention is to provide a method 
and device for significantly managing the bandwidth of a data 
communication network, over which unbalanced bi-directional TCP traffic 
streams are transmitted, without generating any dummy packet and wasting 
the bandwidth based on the TDQ-RCS using Maximum Segment Size 
(MSS) header according to the present invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Other aspects and advantages of the invention will become apparent 
from the following descriptions taken in conjunction with the 
accompanying drawings, wherein: 

Fig. 1 shows a simplified schematic block diagram of an ideal time 
division queue rate control scheme (TDQ-RCS) according to one 
embodiment of the present invention; 

Fig. 2(a) shows a flow chart of an input packet of the ideal TDQ- 
RCS of Fig. 1; 

Fig. 2(b) shows a flow chart of a schedule indicator of the ideal 
TDQ-RCS of Fig. 1; 

Fig. 3 shows a simplified schematic diagram of an approximately 
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ideal TDQ-RCS according to another embodiment of the present invention; 

Fig. 4(a) shows a flow chart of an input packet of the approximately 
ideal TDQ-RCS of Fig. 3; 

Fig. 4(b) shows a flow chart of a schedule indicator of the 
approximately ideal TDQ-RCS of Fig. 3. 

Fig. 5(a) shows a schematic diagram of MSS in SYN segment; and 

Fig. 5(b) shows a flow chart of approximation TDQ-RCS with MSS. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

The present invention now will be described more clearly with 
reference to the accompanying drawings, in which embodiments of the 
invention are shown. Although one of the embodiments illustrated relates 
to a CMOS image sensor application, those skilled in the art will appreciate 
that this invention may be embodied in many different forms set forth 
herein. These embodiments are provided so that this disclosure will be 
thorough and complete, and will fully convey the scope of the invention to 
those skilled in the art. 

Reference now will be made in detail to the preferred embodiments 
of the present invention as illustrated in the accompanying drawings in 
which like reference numerals designate like or corresponding elements 
throughout the drawings. 

BANDWIDTH MANAGEMENT SCHEME 

A bandwidth management device for use in the network according to 
the present invention controls the bandwidth of each incoming traffic 
stream of the bandwidth management device, such as a QoS router, based 
on the predefined Policy-Based QoS Rules. The bandwidth management 
scheme according to an embodiment of the present invention is the so- 



f 7 / H f»US\US-3377.DOC/JAN 



US-3377 



called TDQ-RCS. This TDQ-RCS scheme of the present invention can 
rapidly determine the departure time of the packet arriving at the network 
equipment and transmit the arrival packet out of the bandwidth 
management device, such as a QoS router, on schedule by adding the 

5 arrival packet into its corresponding time division queue according to its 
departure time. Moreover, all algorithms of this scheme can be completed 
in a constant time. Most importantly, the TDQ-RCS neither generates any 
dummy packet nor wastes any bandwidth but still accomplish the 
bandwidth management of the bandwidth management device. Therefore, 

10 by using TDQ-RCS, we can gain the following benefits easily: (1) 
management of network resources, (2) bi-directional bandwidth 
management, (3) guaranteed bandwidth for 

applications/services/customers/stations, and (4) controlled traffic stream 
without generating any dummy packet 

15 TIME-DIVISION-OUEUE RATE CONTROL SCHEME 

To simplify the process of the TDQ-RCS, just like the currently 
available bandwidth management systems, rate control is always conducted 
with knowledge of QoS (Quality of Service) information of input packets. 
That- is, the relevant QoS information always has been attached to the input 

20 packet before a rate control module of the bandwidth management device 
commences the process of the input packets. As well known by persons 
skilled in the art, a flow classification module (not shown) is usually 
provided at the input terminal of the bandwidth management device. The 
flow classification module is to recognize the flow information, such as 

25 maximum rate, minimum rate, committed rate and so on, of input packets 
flowing into the bandwidth management device. Furthermore, several rate 
control rules are set up in the flow classification module. The QoS 
information of the input packets can be derived directly or indirectly from 
the flow information. Details of the flow classification module can be 

30 found in ROC (Taiwan) patent application No. 88121943 and its 
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corresponding US application serial No. 09/498,096. 

Furthermore, in order to simplify the analysis of the bandwidth 
management issue, the present invention first copes with only 
unidirectional traffic streams to be managed in the TDQ-RCS. Then, the 
present invention can deal with very well by just applying two sets of TDQ- 
RCS to control the traffic streams in two different directions so as to 
achieve the bi-directional bandwidth management. 

To realize the TDQ-RCS of the present invention, time domain is 
partitioned into infinite time slots. Each time slot is of constant interval 
and contains one queue, which stores the information relevant to the 
packets that have to be sent out at this time slot on schedule. 

TDEAL TDQ-RCS 

Fig. 1 shows the architecture of an ideal TDQ-RCS according to the 
present invention. First of all, it is defined in the TDQ-RCS for the sake of 
simple analysis that time domain 3 is partitioned into infinite time slots 3 1 
of constant interval, for example 1ms, and a memory 2 of the bandwidth 
management device 1 contains a plurality of memory cells corresponding to 
queues 21. Each queue 21 corresponds to each time slot and thus called a 
time division queue (TDQ) 21. Each TDQ 21 stores information related to 
the input packets 10 to be sent out of the bandwidth management device 1 
at the corresponding time slot on schedule. In fact, it is difficult to have 
infinite time slots as implementing the TDQ-RCS unless the memory 2 is 
extremely huge. Thus, it will be discussed the approximation of the ideal 
TDQ-RCS below. Furthermore, in order to improve the TDQ-RCS in the 
way of processing TCP traffic streams, the concept of setting Maximum 
Segment Size (MSS) [see reference 12 of the appendix for details] is 
applied to the TDQ-RCS. 

Referring to Fig. 2(a), an input packet 10, which includes packet 
contents and associated QoS information, is input, via a channel 11, into a 
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rate evaluator 12 of the bandwidth management device 1. A QoS metering 
module (not shown) in the rate evaluator 12 then determines how to process 
the input packets 10 based on the QoS information of the input packet 10 
(step 21). If the rate of the input packet 10 does not exceed the legal rate 
predetermined by the flow classification module for the input packet 10 as 
a non-over rate packet 13 does (the right branch of Fig. 2(a)), the rate 
evaluator 12 will directly send the input packet 10 out of the bandwidth 
management device 1 (step 22). The legal rate predetermined for the input 
packet 10 is set in the flow rules of the flow classification module. 
Otherwise, the rate evaluator 12 takes the input packets 10 for an over rate 
packet 14, and calculates, based on the QoS information of the over rate 
packet 14, which time slots the over rate packets 14 should be assigned to 
according to the following equations (1) and (2) (step 23). 

POT = CST + PQT (1) 



CST (Current System Time) denotes the current time of the 
bandwidth management device 1 ; 

PQT (Packet Queuing Time) denotes the time that the input 
packet 10 should be queued by TDQ-RCS determined by the QoS 
metering module for rate controlling; 

POT (Packet Output Time) denotes the time that the input 
packet 10 should be transmitted out; 

TSIS (Time Slot Interval Size) denotes the interval size of 
each time slot; and 

TSID (Time Slot ID) denotes the time slot number that the 




where: 
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input packet 10 belongs to. 

After that, the rate evaluator 12 will dispatch (step 24) and append 
the over rate packet 14 into the time division queue 21 of the calculated 
time slot (step 25). 

As shown in Fig. 1, a schedule indicator 22 is provided in the 
memory 2 to indicate which time slot the input packets 10 should be 
flushed out. Referring to Fig. 2(b), the schedule indicator 22 periodically 
progresses to the next time slot in time domain, and the period is equal to 
the interval of the time slot 3 1 such that the time slot that the schedule 
indicator 22 indicates can be always synchronous with the system time of 
the bandwidth management device 1. The progression action of the 
schedule indicator 22 can be formularized as Equation (3) (step 26). 

TSID = PTSID + 1 (3) 

where: 

PTSID (Previous Time Slot ID) denotes the latest on schedule 
time slot number; and 

TSID (Time Slot ID) denotes the on schedule time slot number. 

When the time slot that the schedule indicator 22 progresses to have 
a non-empty time division queue, the bandwidth management device 1 will 
flush all packets queued in the time division queue of this time slot. In this 
way, input packets 10 can be transmitted out of the bandwidth management 
device 1 on schedule. Figs. 2(a) and 2(b) show a flow chart of the input 
packet 10 and the schedule indicator 22 of the ideal TDQ-RCS, respectively. 

As shown in Eqs. (1) to (3), the calculations of all parameters are 
independent of the size of the input packet 10 and the flow No. (i.e., the 
place that this flow comes from), all algorithms of the ideal TDQ-RCS can 
be completed in a constant time, and the ideal TDQ-RCS can control the 
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rate of any unidirectional traffic stream very well. However, it is not 
feasible to have infinite time slots when implementing the ideal TDQ-RCS. 
Thus, an approximation of the ideal TDQ-RCS will be proposed below. 

AN APPROXIMATION OF THE IDEAL TDQ-RCS 

5 Fig. 3 shows the architecture of the approximation of the ideal TDQ- 

RCS according to the present invention, in which a "time ring" 30 is used to 
effectively imitate the function of infinite time slots 3 1 as shown in Fig. 1 . 
The time ring 30 consists of finite time slot clusters 32, and each time slot 
cluster 32 is also of constant time interval, which is equal to the interval of 

10 time slot. As shown in Fig. 3, the time slot cluster 32 may contain one or 
multiple time slots. When implementing the time slot cluster 31 in the 
memory 2, all time slots 31 in the same time slot cluster 32 are always 
sorted in an ascending order based on their respective time slot IDs. Each 
time slot contains a time division queue, and an input packet is stored into a 

15 time division queue of a time slot according to its QoS information. 

Refer to Fig. 4(a), which shows a flow chart of the input packet 10 of 
the approximation TDQ-RCS. All input packets 10 which contain packet 
contents and associated QoS information are still input into the rate 
evaluator 12 first, and the rate evaluator 12 will decide how to process the 
20 input packet 10 according to the QoS information of the input packet 10 
(step 41). If the input packet 10 does not exceed its legal rate, the rate 
evaluator 12 will directly forward it (step 42). Otherwise, the rate evaluator 
12 will calculate which time slot the input packet belongs to based on the 
QoS information of the input packet 10 according to Eqs. (1) to (3) (step 
25 43). Then, the rate evaluator 12 further calculates which time slot cluster 
(TSCID) the calculated time slot (TSID) belongs to (step 44). If the 
calculated time slot cluster (TSCID) has already contained the time slot 
(TSID), which the input packet 10 belongs to (the left branch of step 45), 
the rate evaluator 12 will directly dispatch (step 46) and append the input 
30 packet 10 into the time division queue of the calculated time slot in the 
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calculated time slot cluster (step 47). Otherwise, the rate evaluator 12 will 
insert a new time slot in the calculated time slot cluster (TSCID) and keep 
all time slots in an ascending order based on their IDs (step 48). Then, the 
rate evaluator 12 will dispatch and append the input packet into the time 
division queue of this new time slot in the calculated time slot cluster (step 
47). Equations (4), (5), and (6) show the calculations of the time slot and 
the time slot cluster in the rate evaluator 12. 

POT = GST + PQT (4) 



CST (Current System Time) denotes the current time of the 
bandwidth management device 1 ; 

PQT (Packet Queuing Time) denotes the time that the input 
packet 10 should be queued by the approximation TDQ-RCS for rate 
controlling; 

POT (Packet Output Time) denotes the time that the input 
packet should be transmitted out of the bandwidth management 
device 1; 

TSIS (Time Slot Interval Size) denotes the interval size of 
each time slot 3 1 ; 

TSID (Time Slot ID) denotes the time slot number that the 
input packet 10 belongs to; 

TRS (Time Ring Size) denotes the number of time slot clusters 
in the time ring; and 




■(5) 



TSCID = TSID mod TRS 



•(6) 



where : 
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TSCID (Time Slot Cluster ID) denotes the time slot cluster 
number that the calculated time slot belongs to. 

For the approximation TDQ-RCS, the schedule indicator 22 is also 
used for the time ring 30. The schedule indicator 22 progresses to the next 
time slot cluster around the time ring 30 periodically, and the period is 
equal to the interval of the time slot cluster 32. Refer to Fig. 4(b), when the 
schedule indicator 22 progresses to a new time slot cluster, the system time 
of the bandwidth management device 1 is obtained (step 51) and used to 
calculate which time slot in this new time slot cluster should be processed 
at this time (step 52). So, the schedule indicator 22 can be always 
synchronous with the system time. Similarly, the progress action and the 
time slot calculation can be formularized as Equations (7) and (8), 
respectively. After calculating the time slot, the schedule indicator 22 will 
check whether the ID of the first time slot in this time slot cluster is equal 
to the ID of the calculated time slot. If affirmative, all packets queued in 
the time division queue of this time slot will be flushed (step 53) and this 
time slot is further removed (step 54). Therefore, packets can be 
transmitted out on schedule by using this scheme. For realizing the input 
packet and the schedule indicator processing flow of Approximation TDQ- 
RCS, please refer to Figs. 4(a) and 4(b), respectively. 

OSTSCID = {POSTSCID + l)mod TRS (7) 



TRS (Time Ring Size) denotes the number of time slot clusters 
in the time ring; 

POSTSCID (Previous On Schedule Time Slot Cluster ID) 
denotes the last on schedule time slot cluster number; 
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OSTSCID (On Schedule Time Slot Cluster ID) denotes the on 
schedule time slot cluster number; 

CST (Current System Time) denotes the current time of the 
system; 

TSIS (Time Slot Interval Size) denotes the interval size of 
each time slot; and 

OSTSID (On Schedule Time Slot ID) denotes the on schedule 
time slot number. 

It is time consuming to do the calculation based on the above 
algorithms of the approximation of the ideal TDQ-RCS. That is, before 
dispatching the input packet 10 into the time slot 31, the rate evaluator 12 
has to locate the time slot belonging to the input packet 10 in the calculated 
time slot cluster. Practically, such searching is not easy to be completed 
within a constant time. However, it is a feature in the network environment 
that a transmission traffic stream from any sender is limited. Practically, if 
the size of the time ring 30 is chosen to be large enough, the number of 
time slots 3 1 in any time slot cluster 32 will be bounded by a small number, 
and "the searching can be substantially completed in a constant time. 

Based on above, all algorithms of the approximation of the ideal 
TDQ-RCS can be completed in a reasonable constant time, and the 
approximation TDQ-RCS can function in real time and control the rate of 
any unidirectional traffic stream as good as the ideal TDQ-RCS since these 
algorithms are simple for the input packets of different sizes. 

APPROXIMATION TDQ-RCS WITH MSS 

As mentioned above, the TDQ-RCS can control the rate of any 
unidirectional traffic stream very well. The simple way to achieve bi- 
directional bandwidth management is to use two sets of the TDQ-RCS in 
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the bandwidth management device 1 . However, in order to process a TCP 
(Transmission Control Protocol) traffic stream, the TDQ-RCS has to be 
enhanced to include the "Timeout" and "Acknowledgment" features of the 
TCP traffic streams. To facilitate the understanding of the effects of these 
two features on the TDQ-RCS of the present invention, the following 
situations should be taken into consideration: 

(1) When the legal rate of a TCP traffic stream is very low, and a 
packet of a large size is transmitted from a terminal on the network through 
this TCP traffic stream, the packet of large size may be queued by the 
bandwidth management device 1 for a longer time, thus inevitably resulting 
in a TCP timeout event. In this case, this packet of a large size has to be 
retransmitted by the terminal. 

(2) When two traffic streams of extremely different rates are 
reserved in the same TCP connection in two different directions (for 
example, the rate in one direction is very low and the other is very high), 
and the packet sizes transmitted in these two directions are substantially the 
same. The acknowledgment signal forwarded in the low rate direction by, 
for example, the end point 1 receiving the data packet from the end point 2 
in the high rate direction (see Fig. 5a), is always queued by the bandwidth 
management device 1 for a longer time. The TCP has a specific flow 
control mechanism. That is, the sender has to wait for the acknowledgment 
from the receiver for the prior transmitted packets before transmitting the 
next serial packets. Thus, an ideal rate cannot be achieved in the very high 
rate direction since that the acknowledgment signal which the sender waits 
for transmitted in the low rate direction is always queued by the bandwidth 
management device 1 for a longer time. 

In order to resolve the above-identified situations, according to a 
preferred embodiment of the present invention, the queuing time of the 
packet coming from the sender in the low rate direction is reduced without 
varying the original QoS information. According to the present invention, a 
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packet transmitted by the sender in the low rate direction will be partitioned 
into a series of smaller packets, if the payload size of the packet is larger 
than the legal rate predetermined for said traffic stream based on said QoS 
information. To achieve such partition, an optional header, Maximum 
Segment Size (MSS), of the TCP is employed in the present invention. The 
MSS is to set the largest payload size of the TCP traffic stream. Therefore, 
a packet transmitted by the sender in the low rate direction can be 
partitioned into a series of smaller packets by modifying the MSS of the 
TCP. As well known by persons skilled in the art, the MSS option will only 
appear in a synchronous segment (SYN) when a TCP connection is initially 
set up between two end points over the computer network. Fig. 5(a) shows 
the scheme of modifying the MSS that appears in the SYN segment. 
Referring to Fig. 5(a), when end point 1 intends to transceive data packets 
to/from end point 2, an initial synchronization process will be conducted 
between them in the SYN segment, in which MSS 2 in SYN] from the end 
point 1 indicates the largest payload size of the packet that the end point 1 
can receive from the end point 2, and MSS 2 in SYN 2 from the end point 2 
indicates the largest payload size of the packet that the end point 2 can 
receive from the end point 1. As shown in Fig. 5(a), the bandwidth 
management device 1 according to the present invention is located at the 
connection between intermediary network 1 (such as LAN) connected to 
the end point 1 and an intermediary network 2 (such as WAN) connected to 
the end point 2. When receiving the SYNi and SYN 2 , the rate evaluator 12 
of the bandwidth management device 1 will determine whether the MSS] of 
the packet coming from the end point 1 will cause the two situations 
mentioned above, and again whether the MSS 2 of the packet coming from 
the end point 2 will cause the two situations mentioned above. Fig. 5(b) 
shows a flow chart of the input packet 10 of the Approximation TDQ-RCS 
with MSS. From these two figures, we can clearly see that the bandwidth 
management scheme, Approximation TDQ-RCS with MSS, will determine 
MSS values of both sides according to their respective rates and modify the 
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original MSS values if necessary. Besides, if the MSS has been modified, 
the checksum of TCP header has to be recalculated for the correctness. So, 
either side will never transmit a packet whose payload size is larger than its 
MSS in this TCP transaction. 

5 Given the above, the basic idea of the TDQ-RCS has been explained, 

and an embodiment for implementing the TDQ-RCS in real world has been 
provided and an embodiment of optimizing the TDQ-RCS by modifying the 
MSS. According to the present invention, the following goals can be 
achieved easily: 

10 ( 1 ) Management o f network resources ; 

(2) Bi-Directional Bandwidth Management; 

(3) Guarantee of bandwidth for applications/services/customers/ 
stations; and 

(4) Control of traffic stream without generating any dummy 
15 packet. 

Although the invention has been disclosed in terms of preferred 
embodiments, the disclosure is not intended to limit the invention. The 
invention still can be modified or varied by persons skilled in the art 
without departing from the scope and spirit of the invention, which is 
20 determined by the claims below. 
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